Systematic differences between Cochrane and non-Cochrane meta-analyses on the same topic: a matched pair analysis

BACKGROUND: Meta-analyses conducted via the Cochrane Collaboration adhere to strict methodological and reporting standards aiming to minimize bias, maximize transparency/reproducibility, and improve the accuracy of summarized data. Whether this results in differences in the results reported by meta-analyses on the same topic conducted outside the Cochrane Collaboration is an open question. METHODS: We conducted a matched-pair analysis with individual meta-analyses as the unit of analysis, comparing Cochrane and non-Cochrane reviews. Using meta-analyses from the cardiovascular literature, we identified pairs that matched on intervention and outcome. The pairs were contrasted in terms of how frequently results disagreed between the Cochrane and non-Cochrane reviews, whether effect sizes and statistical precision differed systematically, and how these differences related to the frequency of secondary citations of those reviews. RESULTS: Our search yielded 40 matched pairs of reviews. The two sets were similar in terms of which was first to publication, how many studies were included, and average sample sizes. The paired reviews included a total of 344 individual clinical trials: 111 (32.3%) studies were included only in a Cochrane review, 104 (30.2%) only in a non-Cochrane review, and 129 (37.5%) in both. Stated another way, 62.5% of studies were only included in one or the other meta-analytic literature. Overall, 37.5% of pairs had discrepant results. The most common involved shifts in the width of 95% confidence intervals that would yield a different statistical interpretation of the significance of results (7 pairs). Additionally, 20% differed in the direction of the summary effect size (5 pairs) or reported greater than a 2-fold difference in its magnitude (3 pairs). Non-Cochrane reviews reported significantly higher effect sizes (P < 0.001) and lower precision (P < 0.001) than matched Cochrane reviews. Reviews reporting an effect size at least 2-fold greater than their matched pair were cited more frequently. CONCLUSIONS: Though results between topic-matched Cochrane and non-Cochrane reviews were quite similar, discrepant results were frequent, and the overlap of included studies was surprisingly low. Non-Cochrane reviews report larger effect sizes with lower precision than Cochrane reviews, indicating systematic differences, likely reflective of methodology, between the two types of reviews that could generate different interpretations of the interventions under question

Systematic differences between Cochrane and non-Cochrane meta-analyses on the same topic: a matched pair analysis

BACKGROUND: Meta-analyses conducted via the Cochrane Collaboration adhere to strict methodological and reporting standards aiming to minimize bias, maximize transparency/reproducibility, and improve the accuracy of summarized data. Whether this results in differences in the results reported by meta-analyses on the same topic conducted outside the Cochrane Collaboration is an open question. METHODS: We conducted a matched-pair analysis with individual meta-analyses as the unit of analysis, comparing Cochrane and non-Cochrane reviews. Using meta-analyses from the cardiovascular literature, we identified pairs that matched on intervention and outcome. The pairs were contrasted in terms of how frequently results disagreed between the Cochrane and non-Cochrane reviews, whether effect sizes and statistical precision differed systematically, and how these differences related to the frequency of secondary citations of those reviews. RESULTS: Our search yielded 40 matched pairs of reviews. The two sets were similar in terms of which was first to publication, how many studies were included, and average sample sizes. The paired reviews included a total of 344 individual clinical trials: 111 (32.3%) studies were included only in a Cochrane review, 104 (30.2%) only in a non-Cochrane review, and 129 (37.5%) in both. Stated another way, 62.5% of studies were only included in one or the other meta-analytic literature. Overall, 37.5% of pairs had discrepant results. The most common involved shifts in the width of 95% confidence intervals that would yield a different statistical interpretation of the significance of results (7 pairs). Additionally, 20% differed in the direction of the summary effect size (5 pairs) or reported greater than a 2-fold difference in its magnitude (3 pairs). Non-Cochrane reviews reported significantly higher effect sizes (P < 0.001) and lower precision (P < 0.001) than matched Cochrane reviews. Reviews reporting an effect size at least 2-fold greater than their matched pair were cited more frequently. CONCLUSIONS: Though results between topic-matched Cochrane and non-Cochrane reviews were quite similar, discrepant results were frequent, and the overlap of included studies was surprisingly low. Non-Cochrane reviews report larger effect sizes with lower precision than Cochrane reviews, indicating systematic differences, likely reflective of methodology, between the two types of reviews that could generate different interpretations of the interventions under question

An acoustic charge transport imager for high definition television applications

This report covers: (1) invention of a new, ultra-low noise, low operating voltage APD which is expected to offer far better performance than the existing volume doped APD device; (2) performance of a comprehensive series of experiments on the acoustic and piezoelectric properties of ZnO films sputtered on GaAs which can possibly lead to a decrease in the required rf drive power for ACT devices by 15dB; (3) development of an advanced, hydrodynamic, macroscopic simulator used for evaluating the performance of ACT and CTD devices and aiding in the development of the next generation of devices; (4) experimental development of CTD devices which utilize a p-doped top barrier demonstrating charge storage capacity and low leakage currents; (5) refinements in materials growth techniques and in situ controls to lower surface defect densities to record levels as well as increase material uniformity and quality

Cochrane corner: Sound therapy (using amplification devices and/or sound generators) for tinnitus

This Cochrane Corner features “Sound therapy (using amplification devices or sound generators) for tinnitus” published in 2018. Sereda et al. identified eight clinical trials including 590 participants receiving sound therapy for tinnitus. None of the included studies addressed three main comparisons of the review (comparing hearing aids, sound generators and combination devices with a waiting list control group, placebo or education/information only). One study compared patients fitted with sound generators versus those fitted with hearing aids and found no difference between them in their effects on tinnitus symptom severity. The use of both types of device was associated with a clinically significant reduction in tinnitus symptom severity. Three studies compared hearing aids with a sound generator to hearing aids alone and measured tinnitus symptom severity. The use of both types of device was again associated with a clinically significant reduction in tinnitus symptom severity. This Cochrane review shows that both hearing aids and sound generators may be beneficial for reducing tinnitus severity in some patients, but that there is insufficient evidence at this stage to recommend one device over another, or whether these devices offer any improvement over a placebo treatment

The economic implications of HLA matching in cadaveric renal transplantation.

Abstract Background: The potential economic effects of the allocation of cadaveric kidneys on the basis of tissue-matching criteria are controversial. We analyzed the economic costs associated with the transplantation of cadaveric kidneys with various numbers of HLA mismatches and examined the potential economic benefits of a local, as compared with a national, system designed to minimize HLA mismatches between donor and recipient in first cadaveric renal transplantations. Methods: All data were supplied by the U.S. Renal Data System. Data on all payments made by Medicare from 1991 through 1997 for the care of recipients of a first cadaveric renal transplant were analyzed according to the number of HLA-A, B, and DR mismatches between donor and recipient and the duration of cold ischemia before transplantation. Results: Average Medicare payments for renal-transplant recipients in the three years after transplantation increased from $60,436 per patient for fully HLA-matched kidneys (those with no HLA-A, B, or DR mismatches) to$80,807 for kidneys with six HLA mismatches between donor and recipient, a difference of 34 percent (P\u3c0.001). By three years after transplantation, the average Medicare payments were $64,119 for transplantations of kidneys with less than 12 hours of cold-ischemia time and$74,997 for those with more than 36 hours (P\u3c0.001). In simulations, the assignment of cadaveric kidneys to recipients by a method that minimized HLA mismatching within a local geographic area (i.e., within one of the approximately 50 organ-procurement organizations, which cover widely varying geographic areas) produced the largest cost savings ($4,290 per patient over a period of three years) and the largest improvements in the graft-survival rate (2.3 percent) when the potential costs of longer cold-ischemia time were considered. Conclusions: Transplantation of better-matched cadaveric kidneys could have substantial economic advantages. In our simulations, HLA-based allocation of kidneys at the local level produced the largest estimated cost savings, when the duration of cold ischemia was taken into account. No additional savings were estimated to result from a national allocation program, because the additional costs of longer cold-ischemia time were greater than the advantages of optimizing HLA matching

Casein kinase iδ mutations in familial migraine and advanced sleep phase.

Migraine is a common disabling disorder with a significant genetic component, characterized by severe headache and often accompanied by nausea, vomiting, and light sensitivity. We identified two families, each with a distinct missense mutation in the gene encoding casein kinase Iδ (CKIδ), in which the mutation cosegregated with both the presence of migraine and advanced sleep phase. The resulting alterations (T44A and H46R) occurred in the conserved catalytic domain of CKIδ, where they caused reduced enzyme activity. Mice engineered to carry the CKIδ-T44A allele were more sensitive to pain after treatment with the migraine trigger nitroglycerin. CKIδ-T44A mice also exhibited a reduced threshold for cortical spreading depression (believed to be the physiological analog of migraine aura) and greater arterial dilation during cortical spreading depression. Astrocytes from CKIδ-T44A mice showed increased spontaneous and evoked calcium signaling. These genetic, cellular, physiological, and behavioral analyses suggest that decreases in CKIδ activity can contribute to the pathogenesis of migraine

Simultaneous Disruption of Mouse ASIC1a, ASIC2 and ASIC3 Genes Enhances Cutaneous Mechanosensitivity

Three observations have suggested that acid-sensing ion channels (ASICs) might be mammalian cutaneous mechanoreceptors; they are structurally related to Caenorhabditis elegans mechanoreceptors, they are localized in specialized cutaneous mechanosensory structures, and mechanical displacement generates an ASIC-dependent depolarization in some neurons. However, previous studies of mice bearing a single disrupted ASIC gene showed only subtle or no alterations in cutaneous mechanosensitivity. Because functional redundancy of ASIC subunits might explain limited phenotypic alterations, we hypothesized that disrupting multiple ASIC genes would markedly impair cutaneous mechanosensation. We found the opposite. In behavioral studies, mice with simultaneous disruptions of ASIC1a, -2 and -3 genes (triple-knockouts, TKOs) showed increased paw withdrawal frequencies when mechanically stimulated with von Frey filaments. Moreover, in single-fiber nerve recordings of cutaneous afferents, mechanical stimulation generated enhanced activity in A-mechanonociceptors of ASIC TKOs compared to wild-type mice. Responses of all other fiber types did not differ between the two genotypes. These data indicate that ASIC subunits influence cutaneous mechanosensitivity. However, it is unlikely that ASICs directly transduce mechanical stimuli. We speculate that physical and/or functional association of ASICs with other components of the mechanosensory transduction apparatus contributes to normal cutaneous mechanosensation

Zika virus tropism and interactions in myelinating neural cell cultures: CNS cells and myelin are preferentially affected

The recent global outbreak of Zika virus (ZIKV) infection has been linked to severe neurological disorders affecting the peripheral and central nervous systems (PNS and CNS, respectively). The pathobiology underlying these diverse clinical phenotypes are the subject of intense research; however, even the principal neural cell types vulnerable to productive Zika infection remain poorly characterised. Here we used CNS and PNS myelinating cultures from wild type and Ifnar1 knockout mice to examine neuronal and glial tropism and short-term consequences of direct infection with a Brazilian variant of ZIKV. Cell cultures were infected pre- or post-myelination for various intervals, then stained with cell-type and ZIKV-specific antibodies. In bypassing systemic immunity using ex vivo culture, and the type I interferon response in Ifnar1 deficient cells, we were able to evaluate the intrinsic infectivity of neural cells. Through systematic quantification of ZIKV infected cells in myelinating cultures, we found that ZIKV infection is enhanced in the absence of the type I interferon responses and that CNS cells are considerably more susceptible to infection than PNS cells. In particular, we demonstrate that CNS axons and myelinating oligodendrocytes are especially vulnerable to injury. These results have implications for understanding the pathobiology of neurological symptoms associated with ZIKV infection. Furthermore, we provide a quantifiable ex vivo infection model that can be used for fundamental and therapeutic studies on viral neuroinvasion and its consequences

Is tagging with visual implant elastomer a reliable technique for marking earthworms?

Visual implant elastomer (VIE) has recently been employed to investigate different aspects of earthworm ecology. However, a number of fundamental questions relating to the detection and positioning of the tag, its persistence and potential effects on earthworms remain unknown. Seven earthworm species belonging to three ecological groupings, with different pigmentation and burrowing behaviour, were tagged using different coloured VIE. External inspection after two days, one week and 1, 10 and 27 months were followed by preservation, dissection and internal inspection. Tags could be seen in living specimens to 27 months, and dissection revealed that in most cases they were lodged in the coelomic cavity, held in place by septa. However, over longer time periods (more than two years), the chlorogogenous tissue tended to bind to the tags and made external observation increasingly difficult. Migration of the VIE material towards the posterior of the earthworm and potential loss of the tag were only observed on rare occasions, and a recovery rate in excess of 98% was recorded. By introducing a reasonable amount of VIE into segments, just after the clitellum, this technique can become a valuable tool in earthworm ecology and life history studies, particularly in short-medium term laboratory and field experiments

Extent of MGMT promoter methylation modifies the effect of temozolomide on overall survival in patients with glioblastoma: a regional cohort study

BACKGROUND: MGMT methylation in glioblastoma predicts response to temozolomide but dichotomizing methylation status may mask the true prognostic value of quantitative MGMT methylation. This study evaluated whether extent of MGMT methylation interacts with the effect of temozolomide on overall survival. METHODS: We included consecutive glioblastoma patients aged ≥16 years diagnosed (April 2012–May 2020) at a neuro-oncology center. All patients had quantitative MGMT methylation measured using pyrosequencing. Those with MGMT methylated tumors were stratified into high and low methylation groups based on a cut-off using Youden index on 2-year survival. Our accelerated failure time survival models included extent of MGMT methylation, age, postoperative Karnofsky performance score, extent of resection, temozolomide regimen, and radiotherapy. RESULTS: There were 414 patients. Optimal cut-off point using Youden index was 25.9% MGMT methylation. The number of patients in the unmethylated, low and high methylation groups was 223 (53.9%), 81 (19.6%), and 110 (26.6%), respectively. In the adjusted model, high (hazard ratio [HR] 0.60, 95% confidence intervals [CI] 0.46–0.79, P = 0.005) and low (HR 0.67, 95% CI 0.50–0.89, P < 0.001) methylation groups had better survival compared to unmethylated group. There was no evidence for interaction between MGMT methylation and completed temozolomide regimen (interaction term for low methylation P = 0.097; high methylation P = 0.071). This suggests no strong effect of MGMT status on survival in patients completing temozolomide regimen. In patients not completing the temozolomide regimen, higher MGMT methylation predicted better survival (interaction terms P < 0.001). CONCLUSIONS: Quantitative MGMT methylation may provide additional prognostic value. This is important when assessing clinical and research therapies